27 research outputs found
On the Hardness of Partially Dynamic Graph Problems and Connections to Diameter
Conditional lower bounds for dynamic graph problems has received a great deal
of attention in recent years. While many results are now known for the
fully-dynamic case and such bounds often imply worst-case bounds for the
partially dynamic setting, it seems much more difficult to prove amortized
bounds for incremental and decremental algorithms. In this paper we consider
partially dynamic versions of three classic problems in graph theory. Based on
popular conjectures we show that:
-- No algorithm with amortized update time exists for
incremental or decremental maximum cardinality bipartite matching. This
significantly improves on the bound for sparse graphs
of Henzinger et al. [STOC'15] and bound of Kopelowitz,
Pettie and Porat. Our linear bound also appears more natural. In addition, the
result we present separates the node-addition model from the edge insertion
model, as an algorithm with total update time exists for the
former by Bosek et al. [FOCS'14].
-- No algorithm with amortized update time exists for
incremental or decremental maximum flow in directed and weighted sparse graphs.
No such lower bound was known for partially dynamic maximum flow previously.
Furthermore no algorithm with amortized update time
exists for directed and unweighted graphs or undirected and weighted graphs.
-- No algorithm with amortized update time exists
for incremental or decremental -approximating the diameter
of an unweighted graph. We also show a slightly stronger bound if node
additions are allowed. [...]Comment: To appear at ICALP'16. Abstract truncated to fit arXiv limit
Finding Even Cycles Faster via Capped k-Walks
In this paper, we consider the problem of finding a cycle of length (a
) in an undirected graph with nodes and edges for constant
. A classic result by Bondy and Simonovits [J.Comb.Th.'74] implies that
if , then contains a , further implying that
one needs to consider only graphs with .
Previously the best known algorithms were an algorithm due to Yuster
and Zwick [J.Disc.Math'97] as well as a algorithm by Alon et al. [Algorithmica'97].
We present an algorithm that uses time and finds a
if one exists. This bound is exactly when . For
-cycles our new bound coincides with Alon et al., while for every our
bound yields a polynomial improvement in .
Yuster and Zwick noted that it is "plausible to conjecture that is
the best possible bound in terms of ". We show "conditional optimality": if
this hypothesis holds then our algorithm is tight as well.
Furthermore, a folklore reduction implies that no combinatorial algorithm can
determine if a graph contains a -cycle in time for any
under the widely believed combinatorial BMM conjecture. Coupled
with our main result, this gives tight bounds for finding -cycles
combinatorially and also separates the complexity of finding - and
-cycles giving evidence that the exponent of in the running time should
indeed increase with .
The key ingredient in our algorithm is a new notion of capped -walks,
which are walks of length that visit only nodes according to a fixed
ordering. Our main technical contribution is an involved analysis proving
several properties of such walks which may be of independent interest.Comment: To appear at STOC'1
Fast and Compact Exact Distance Oracle for Planar Graphs
For a given a graph, a distance oracle is a data structure that answers
distance queries between pairs of vertices. We introduce an -space
distance oracle which answers exact distance queries in time for
-vertex planar edge-weighted digraphs. All previous distance oracles for
planar graphs with truly subquadratic space i.e., space
for some constant ) either required query time polynomial in
or could only answer approximate distance queries.
Furthermore, we show how to trade-off time and space: for any , we show how to obtain an -space distance oracle that answers
queries in time . This is a polynomial
improvement over the previous planar distance oracles with query
time
Fast Similarity Sketching
We consider the Similarity Sketching problem: Given a universe we want a random function mapping subsets into vectors of size , such that similarity is preserved. More
precisely: Given sets , define and
. We want to have , where
and furthermore to have strong concentration
guarantees (i.e. Chernoff-style bounds) for . This is a fundamental problem
which has found numerous applications in data mining, large-scale
classification, computer vision, similarity search, etc. via the classic
MinHash algorithm. The vectors are also called sketches.
The seminal MinHash algorithm uses random hash functions
, and stores as the sketch of . The main drawback of MinHash is,
however, its running time, and finding a sketch with similar
properties and faster running time has been the subject of several papers.
Addressing this, Li et al. [NIPS'12] introduced one permutation hashing (OPH),
which creates a sketch of size in time, but with the drawback
that possibly some of the entries are "empty" when . One could
argue that sketching is not necessary in this case, however the desire in most
applications is to have one sketching procedure that works for sets of all
sizes. Therefore, filling out these empty entries is the subject of several
follow-up papers initiated by Shrivastava and Li [ICML'14]. However, these
"densification" schemes fail to provide good concentration bounds exactly in
the case , where they are needed. (continued...
Practical Hash Functions for Similarity Estimation and Dimensionality Reduction
Hashing is a basic tool for dimensionality reduction employed in several
aspects of machine learning. However, the perfomance analysis is often carried
out under the abstract assumption that a truly random unit cost hash function
is used, without concern for which concrete hash function is employed. The
concrete hash function may work fine on sufficiently random input. The question
is if it can be trusted in the real world when faced with more structured
input.
In this paper we focus on two prominent applications of hashing, namely
similarity estimation with the one permutation hashing (OPH) scheme of Li et
al. [NIPS'12] and feature hashing (FH) of Weinberger et al. [ICML'09], both of
which have found numerous applications, i.e. in approximate near-neighbour
search with LSH and large-scale classification with SVM.
We consider mixed tabulation hashing of Dahlgaard et al.[FOCS'15] which was
proved to perform like a truly random hash function in many applications,
including OPH. Here we first show improved concentration bounds for FH with
truly random hashing and then argue that mixed tabulation performs similar for
sparse input. Our main contribution, however, is an experimental comparison of
different hashing schemes when used inside FH, OPH, and LSH.
We find that mixed tabulation hashing is almost as fast as the
multiply-mod-prime scheme ax+b mod p. Mutiply-mod-prime is guaranteed to work
well on sufficiently random data, but we demonstrate that in the above
applications, it can lead to bias and poor concentration on both real-world and
synthetic data. We also compare with the popular MurmurHash3, which has no
proven guarantees. Mixed tabulation and MurmurHash3 both perform similar to
truly random hashing in our experiments. However, mixed tabulation is 40%
faster than MurmurHash3, and it has the proven guarantee of good performance on
all possible input.Comment: Preliminary version of this paper will appear at NIPS 201
Sublinear Distance Labeling
A distance labeling scheme labels the nodes of a graph with binary
strings such that, given the labels of any two nodes, one can determine the
distance in the graph between the two nodes by looking only at the labels. A
-preserving distance labeling scheme only returns precise distances between
pairs of nodes that are at distance at least from each other. In this paper
we consider distance labeling schemes for the classical case of unweighted
graphs with both directed and undirected edges.
We present a bit -preserving distance labeling
scheme, improving the previous bound by Bollob\'as et. al. [SIAM J. Discrete
Math. 2005]. We also give an almost matching lower bound of
. With our -preserving distance labeling scheme as a
building block, we additionally achieve the following results:
1. We present the first distance labeling scheme of size for sparse
graphs (and hence bounded degree graphs). This addresses an open problem by
Gavoille et. al. [J. Algo. 2004], hereby separating the complexity from
distance labeling in general graphs which require bits, Moon [Proc.
of Glasgow Math. Association 1965].
2. For approximate -additive labeling schemes, that return distances
within an additive error of we show a scheme of size for .
This improves on the current best bound of by
Alstrup et. al. [SODA 2016] for sub-polynomial , and is a generalization of
a result by Gawrychowski et al. [arXiv preprint 2015] who showed this for
.Comment: A preliminary version of this paper appeared at ESA'1
Fast hashing with Strong Concentration Bounds
Previous work on tabulation hashing by Patrascu and Thorup from STOC'11 on
simple tabulation and from SODA'13 on twisted tabulation offered Chernoff-style
concentration bounds on hash based sums, e.g., the number of balls/keys hashing
to a given bin, but under some quite severe restrictions on the expected values
of these sums. The basic idea in tabulation hashing is to view a key as
consisting of characters, e.g., a 64-bit key as characters of
8-bits. The character domain should be small enough that character
tables of size fit in fast cache. The schemes then use tables
of this size, so the space of tabulation hashing is . However, the
concentration bounds by Patrascu and Thorup only apply if the expected sums are
.
To see the problem, consider the very simple case where we use tabulation
hashing to throw balls into bins and want to analyse the number of
balls in a given bin. With their concentration bounds, we are fine if ,
for then the expected value is . However, if , as when tossing
unbiased coins, the expected value is for large data sets,
e.g., data sets that do not fit in fast cache.
To handle expectations that go beyond the limits of our small space, we need
a much more advanced analysis of simple tabulation, plus a new tabulation
technique that we call \emph{tabulation-permutation} hashing which is at most
twice as slow as simple tabulation. No other hashing scheme of comparable speed
offers similar Chernoff-style concentration bounds.Comment: 54 pages, 3 figures. An extended abstract appeared at the 52nd Annual
ACM Symposium on Theory of Computing (STOC20